Is there anything 'below' Earth in space?

Earth and its neighbors orbit the sun on a relatively flat plane. But what's below this plane, and is anythign below the Earth?